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Abstract : In this paper, we prove large deviations principle for the 
Nadaraya- Watson estimator and for the semi-recursive ker- 
nel estimator of the regression in the multidimensional case. 
Under suitable conditions, we show that the rate func- 
tion is a good rate function. We thus generalize the re- 
sults already obtained in the unidimensional case for the 
Nadaraya- Watson estimator. Moreover, we give a moder- 
ate deviations principle for these two estimators. It turns 
out that the rate function obtained in the moderate devi- 
ations principle for the semi-recursive estimator is larger 
than the one obtained for the Nadaraya- Watson estimator. 
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1 Introduction 



Let (X, Y), (Xi,Yi), . . . , (X n ,Y n ) be a sequence of independent and identically distributed R d x Re- 
valued random variables with probability density f(x,y) with E|Y| < oo. Moreover, let g{x) be 
the marginal density of X and r{x) = E (Y|A = x) = m(x)/g(x) the regression of Y on X. The 
purpose of this paper is to establish large and moderate deviations principles for the Nadaraya- 
Watson estimator and for the semi-recursive kernel estimator of the regression. 

Let us first recall the concept of large and moderate deviations. A speed is a sequence {v n ) of 
positive numbers going to infinity. A good rate function on R m is a lower semicontinuous function 
/ : R m — > [0,oo] such that, for each a < 00, the level set {x E R m , I(x) < a} is a compact set. 
If the level sets of / are only closed, then / is said to be a rate function. A sequence (Z n ) n >i of 
R m -valued random variables is said to satisfy a large deviations principle (LDP) with speed {v n ) 
and rate function / if: 

liminf v~ l logP [Z n G U] > — inf I(x) for every open subset U of R m , 

lim sup log P \Z n 6 V] < — inf I(x) for every closed subset V of R m . 

n->oo * xGV 

Moreover, let (v n ) be a nonrandom sequence that goes to infinity; if (v n Z n ) satisfies a LDP, then 
(Z n ) is said to satisfy a moderate deviations principle (MDP). 

The Nadaraya- Watson estimator (p2], [2Q]) of the regression function r(x) is defined by 

IJx) lf 9n[x) + ° (1) 
otherwise, 

with 

1 s—^ f x — Xj\ , , s 1 v-^ f x — Xj 



where the bandwidth (h n ) is a positive sequence such that 

lim h n = and lim nh^ = 00, (2) 

n— »oo n— >oo 

and the kernel K a continuous function such that liio.|| a; ||_ >00 K(x) = and J^ d K(x)dx = 1. The 
weak and strong consistency of r n has been widely discussed by many authors; let us cite, among 
many others, Collomb [3], Collomb and Hardle [5], Devroye [7], Mack and Silverman [12] and 
Senoussi [19J. For other works on the consistency of r n , the reader is refered to the monographs of 
Bosq |3j and Prakasa Rao [16]. The large deviations behaviour of r n has been studied at first by 
Louani [11], and then by Joutard [10J in the univariate framework. Moderate deviations principles 
have been obtained by Worms [21] in the particular case Y = r(X) + e with e and X independent. 
The first aim of this paper is to generalize these large and moderate deviations results. 

The approach used by Louani [11] and Joutard [10] to study the large deviations behaviour of 
r n is to note that, if d = q = 1 and if the kernel is positive, then, for all 5 > 0, 



\r n {x) - r(x) > 5} 



iE«-H*)-^(^)>o 
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Obviously, their approach can not be extended to the multivariate framework. Thus, to study 
the large deviations behaviour of r n , our approach is totally different. We first establish a large 
deviations principle for the sequence (m n (x) , g n (x)) , and then show how the large deviations be- 
haviour of r n can be deduced. More precisely, for x £ M. d , let ty x be the function defined for any 

(u, !))el«xlby 



**(u,v) = / (e« u ^ K ^-l)f(x,y)dzdy, 

(where (u, y) denotes the scalar product of u and y) and let I x be the Fenchel-Legendre transform 
of ty x . We give conditions ensuring that the sequence (r n (x)) satisfies a LDP with speed (nh^) and 
good rate function J defined, for any s G K ? , by 

J(s) = inf I x (st, t). 

t£R 

Concerning the moderate deviations behaviour of the Nadaraya- Watson estimator, we prove 
that, for any positive sequence (v n ) such that 

v 2 

lim v n = co, lim — — T = 0, and lim v n hP n = 0, (3) 

ri— >oo n^oo Tlhi n—*oo 

(where p denotes the order of the kernel K) the sequence (v n [r n {x) — r(x)\) satisfies a LDP with 
speed (nh^/v~) and good rate function G x defined for all v £ M 9 by 

where T, x denotes the qx q covariance matrix V C^l-X" = x). Let us note that, in the case the model 
Y = r(X) + e (with X and e independent) is considered, the matrix T, x is the covariance matrix of 
e and does depend on x; we then find the MDP proved in Worms [21] again. 

A semi-recursive version of the Nadaraya- Watson estimator (|TJ) is defined as 

mJx) 



if g n (x) / 



r n (x) = { 9n{x) (5) 
otherwise, 



where 



Weak conditions for various forms of consistency of f n have been obtained by Ahmad and Lin pQ 
and Devroye and Wagner 0. Roussas [18] studied its almost sure convergence rate. The second 
aim of this paper is to establish the large and moderate deviations behaviour of r n . 



It turns out that the rate function that appears in the LDP is much more complex to explicit in 
the case the semi-recursive kernel regression estimator is considered than in the case the Nadaraya- 
Watson estimator is used. That is the reason why we only consider bandwidths defined as (h n ) = 
(cn~ a ) with c > and a g]0, l/d[ (instead of bandwidths satisfying ([2])). For x G W 1 , let ^f a>x be 
the function defined for all (u, v) £ M q x M by 

*«,*(«,«) = I s-^(e sad ^+^ K W -l)f(x,y)dsdzdy, 

J[0,l]xR d xRi v 7 
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and let I a , x be the Fenchel-Legendre transform of ^ a ,x- We give conditions ensuring that the 
sequence (r n (x)) satisfies a LDP with speed (nh^) and good rate function J a defined, for any 
s G R q , by 

J a (s) = inf I ax (st,t). 

To establish the moderate deviations behaviour of f n , we consider bandwidths (h n ) which vary 
regularly with exponent (—a), a g]0, l/d[. We prove that, for any positive sequence (v n ) satisfying 
([3]), the sequence (v n [r n (x) — r(x)]) satisfies a LDP with speed (nh^/vfy and good rate function 
defined for all v G M q by 

~ (1 + ad)g(x) r i , , 

GaAv) ~ 2j Rd K^z)dz V ^ V - {6) 

Let us underline that, because of the factor (1 + ad) which is present in © but not in @, the rate 
function obtained in the MDP in the case the semi-recursive estimator is used is larger than the 
one which appears in the case the Nadaraya- Watson kernel estimator is considered; this means that 
the semi-recursive estimator f n (x) is more concentrated around r{x) than the Nadaraya- Watson 
estimator. 

Our main results are stated in Section 2, whereas Section 3 is devoted to the proofs. 

2 Assumptions and Main Results 

We shall use the following notations. 

o 

• T>{T) = {x, J-(x) < oo} denotes the domain of a function T and ^(J 7 ) is the interior domain 
of T. 

• 1 1 £ 1 1 is the euclidean norm of x. 

• A is the Lebesgue measure. 

• a Ab = min{a, b}. 

• = (0, ...,0) G R«. 

The large and moderate deviations behaviours of the Nadaraya- Watson estimator r n are given 
in Section 2.1, whereas the ones of the semi-recursive kernel estimator f n are stated in Section 2.2. 

2.1 Large and moderate deviations principles for the Nadaraya- Watson estima- 
tor 

The assumptions required for the LDP of the Nadaraya- Watson estimator are the following. 
(Al) K : R. d — > R is a bounded and integrable function, J Rd K(z)dz = 1 and limiuii^oo K(z) = 0. 

(A2) For any u G W, 1 1— > / e^ u ' y ^ f(t,y)dy is continuous at x and bounded. 

JR1 
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Comments 

• Notice that (A2) implies that the density g is continuous at x and bounded. 

• In the model Y = r(X) + e with e and X independent, let h be the probability density of e. 
Then 



f(t,y) = g(t)h(y-r(t)) 
\y\\f(t,y)dy = g(t) [ \\y + r(t)\\h(y)dy 



[ e^f(t,y)dy = g(t)e^ r ^ I e^h{y)dy. 
Jri JM.1 

Thus, (A2) can be translated as assumptions on g and r and on the moments of e. 

• As it can be seen from the proofs, the boundness assumption in (A2) is useless if K has a 
compact support. 

• The boundness of the function t^l e^'^ f(t,y)dy for any m6R' implies that 

Jri 

Vm>0,V/?>0 the function t ^ / \\y\\ m e pM f{t,y)dy is bounded. (7) 

Proof It suffices to prove that the function ^ / e p " y "/(i, y)dy is bounded for any p > 0. 
Set y = (yi, . . . , y q ), we first note that 

[ e qp Mf(t,y)dy < [ e^f(t,y)dy+ [ f(t,y)dy 
Jri J{yj>o} J{yj<o} 

< ! e*Wf(t,y)dy+ [ e~*W f(t,y)dy. 
its JR<i 

Now, we have 
/ e p ^f(t,y)dy 

JRi 

< [ e p ^ + - +p ^f(t,y)dy 
Jri 

< ( e qpM f(t, y)dy ... i e qpM f(t, y)dy) " by the generalized Holder inequality. 
\Jri JRi J 

< fff e «™f{t,y)dy+ [ e~ q ^ f(t,y)dy] . . . ( I e™f(t,y)dy+ [ e"««" f(t,y)dy 
V \ Jri Jri / \Jri Jri 

which is bounded. 

Before stating our results, we need to introduce the rate function for the LDP of the Nadaraya- 
Watson estimator. Let ^> x : M. q x R — ► R and I X ,I X : 1' x 1 ^ R be the functions defined as 
follows: 

*x(u,v) = [ (e^ + ^ K ^ -l)f(x,y)dzdy, (8) 

jR d xRi v 7 

I x {h,t2) = sup {(u,ti) +vt 2 - V x (u,v)} , (9) 

(u,v)£RixR 

L(s,t) = I x (st,t). (10) 



Moreover, for any s € M q , set 

J*(s) = inf iJst.t) 

tm* 

= inf I x (s,t), 
teR* 

J (a) = J*(s) A 4(0,0) 
= inf 4 

To prove that J is a rate function, we need to assume that the following condition (C) is fulfilled. 

(C) inf s6R9 l x (s,0) =4(0,0). 

Before stating the properties of the function J, let us give some cases when Condition (C) is satisfied 
(under Assumptions (Al) and (A2)). 

Example 1: Nonnegative kernel 

Condition (C) is satisfied when K is nonnegative since, in this case, l x (s,0) = +oo for any s ^ 0, 
(this is stated in Proposition [3] of Section 3). 

Example 2: Model with symmetry 

Condition (C) holds when / is symmetric in each coordinate of the second variable y £ M q . As a 
matter of fact, for a diagonal q x q matrix A such that An = ±1, observe that 

* x (Au,v) = [ (e« Au ^ K W-l)f(x,y)dzdy 

e ({ U ,Ay)+v)K(z) _ A ffayjfcdy 
e ((u,y')+v)K(z) _ A f( XiA ~ly>) dzd y> 

'XI' ^ ' 

■$ x (u,v). 



For any given s£R', set 



We have, 



U s = {u€R q , (u,s) >0}. 



sup(-^ x {u,v)) = sup (-V x (u,v)). 

u,v ueu 3 , veM 

Now, for any u 6 IA S and w£K, 

(it, s) - y x (u, v) > -^ x (u, v), 

so that 

sup{(u, s) - W x (u,v)} > sup (-y x (u,v)), 
u,v ueu s , v<=M 

and thus, 

4(0,0) < I x («,0) VsGM 9 , 

so that Condition (C) follows. 
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Example 3: A negative kernel without symmetry assumption on /, and for d = q = 1 

If the kernel K can be written as K = l£> — 1^/ where D and D' are two subsets of M such that 
D n D' = and A(Z?) — A(D') = 1, then Condition (C) holds. As a matter of fact, we then have 

* x (u,v) = [ U U ^ K ^ -l) f(x,y)dzdy 

= / {e uy+v - 1) f(x, y)dzdy + f (e"^"" - l) /(x, y)dzdy 

JDxR JD'xWL 

= e v X(D) I e u yf(x,y)dy-[X(D) + X(D')}g(x) + e- v X(D') [ e'^ f(x,y)dy. 

Now, let M x denote the Laplace transform of f(x, •), then 

«) = e^A(L»)M :c H + e-"A(D')M x (- M ) - [A(Z>) + X(D')] g(x). 
For any given u, it can easily be seen that the infimum of ^f x (u, ■) is reached at 



v o = log 

and 



1 X(D')M x (-u) 
X(D)M x (u) ' 



* x («,t;o) = 2y/X(D)X(D')^M x (u)M x (-u) - [X(D) + X(D')] g(x). 

Observe that 

V x {u,v ) = $> x (-u,v ), 

and thus 

sup (-* x (u, uo)) = sup(-* x (it,uo)) 

M u>0 

= sup(-* x (u,uo)) 

«<0 

= 4(0,0). 

Now, if s > 0, we have for any u > 

us - $> x (u,v ) > -W x (u,vo), 

and thus 

4(s,0) > 4(0,0) Vs>0. 

Proceeding in the same way for s < 0, we obtain Condition (C). 

Such an example of a four order kernel is K = l[- tt ,a] ~~ l[-6,-a[u]a,6]j with 



2 1 

+ 3 



3 6 V J 6 
Let us now give the properties of the function J. 
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Proposition 1 Assume that (Al), (A2) and (C) hold. Then, 

(i) J is a rate function on M q . More precisely, for q£1, 

• if a < is (0,0), then {J(s) < a} is compact. 
•ifa> 4(0,0), then {J{s) < a} = R q . 

(ii) If I x (0, 0) = oo, then J is a good rate function on M q and J = J* . 
(Hi) If J*(s) < oo, then J(s) = J*(s). 

(iv) If a < 4(0,0), then {J*(s) < a} = {J(s) < a}. 
Remark 1 In view of the definition of J and J*, and of Proposition [7] (Hi), we have: 



J(s) 



J*{s) if J*{s) < oo 
4(0,0) if J*(s) =oo. 



Let us now state the LDP for the Nadaraya- Watson estimator. 

Theorem 1 (Pointwise LDP for the Nadaraya- Watson estimator) 

Assume that (Al), (A2) and (C) hold, and that (h n ) satisfies the conditions in (|2|). Then, for any 
open subset U ofM q , 

liminf -5-rlogP[r n (x) €U]>- inf J* (a), 
n— >oo nh^ sell 

and for any closed subset V ofR q , 

limsup — — j logP [r n (x) £ V] < — inf J(s). 

Comments. 

1) Set E = { J*(s) < oo}. For any open subset U of R q such that U n E 0, we have 

liminf — -r logP \r n (x) G U] > - inf J(s). 

n—>oo nh^ ' seU 

2) If 4 is finite in a neighbourhood of (0,0), then J* is finite everywhere and by Proposition Q] 

(iii), J(s) = J*(s) < oo Vs ; thus (r n ) satisfies a LDP with speed (nh%) and rate function J. 
Of course, this does not hold for nonnegative kernel since in this case I x (s, 0) = +oo for any s 
(see Proposition [3] in Section 3). However, it can hold for kernels which take negative values. 
For example, consider the previous Example 3, and assume f(x,y) is symmetric in y ; in this 
case M x (u) = M x {— u). The equation 

99 x 



dv 



(u,v) = [\{D)e v - \{D')e~ v ] M x (u) = 



has solution vq = log a )— — independent from u. Moreover, M' is continuous and has range 
R, thus, there exists uq such that M'(uq) = 0. This implies that the equation 

<m "-(u,v) = [X(D)e v + X(D')e- v ) M' x {u) = 



du 

has a solution uq independent from v. Thus (0,0) is in the range of V^. It follows from 
Proposition [3] Section 3 that 4 is finite in a neighbourhood of (0,0). 
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3) When I x (0,0) = oo, it follows from Proposition Q] and Theorem [T] that (r n ) satisfies a LDP with 
speed (nh^) and good rate function J. 

In the case K is a nonnegative kernel whose support has an infinity measure, we will show in 
Proposition [3] that I x (0, 0) = oo. We have thus the following corollary. 

Corollary 1 Let the assumptions of Theorem [7] hold. If K is a nonnegative kernel such that 
A ({x £ R rf , K{x) > 0}) = oo, then the sequence (r ra ) satisfies a LDP with speed (nh^) and good 
rate function J. 

This corollary is an extension of the results of Louani [11] and Joutard [lOj to the multivariate 
framework (and to the case the kernel K may vanish). Moreover, it proves that the rate function 
that appears in their large deviations results is in fact a good rate function. 

To establish pointwise MDP for the Nadaraya- Watson estimator, we need the following addi- 
tionnal assumptions. 

(A3) For any . 6 M«, ,,»/(*, ,)* and t„f (u,y) I{t , V )iy are continuous at , and 

g(x) + 0. 

nh d 

(A4) lim^oo v n = oo and lim^oo = oo. 

v 

(A5) i) There exists an integer p > 2 such that Vs G {1, . . . ,p — 1}, V? € {1, ... , d}, 
y S jK(y)dyj = 0, and / < oo. 

ii) lim^ooHn/i^ = 0. 

iii) m and 5 are p-times differentiable on R d , and their differentials of order p are bounded 
and continuous at x. 

We can now state the MDP for the Nadaraya- Watson estimator. 

Theorem 2 (Pointwise MDP for the Nadaraya- Watson kernel estimator of the regression) 

Assume that (A1)-(A5) hold. Then, the sequence (v n (r n (x) — r(x))) satisfies a LDP with speed 
nh d \ 

— Tp- and good rate function G x defined in (HI) . 
< J 

2.2 Large and moderate deviations principles for the semi-recursive estimator 

For a e]0, l/d[, let V a>x : W x R -> R and I ajX : R q x R -> R be the functions defined as follows: 

= / S - ad (e sad ^+")^-l)/(x,y)d S ^, (11) 

J[0,l]xR d xK'J V ' 

Ia,x(tl,t 2 ) = SUp |(«,tl) +«*2- *o,x(w,v)[ • (12) 

(n,i))GlR9xR L J 

Moreover, let J a and J* be defined as follows: for any s£l', 

J* a (s) = mfl a>x (st,t) (13) 
J a (s) = J*(s) A 7^(0,0). (14) 

Let us give the following additionnal hypotheses. 
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(A'l) For any u G R 9 , t h / e a ^ u ' y ^ f(t,y)dy is continuous at x uniformly with respect to 

if 

a G [0,1]. 

Condition (C) above is substituted by the following one, 

(C) inf seK , l a>x (s,0) = 1^(0,0). 

Examples for which Condition (C) holds are Examples 1 and 2 given for (C). The following propo- 
sition gives the properties of the function J a . 

Proposition 2 Assume that (Al), (A2), (A'l) and (C) hold. Then, 

(i) J a is a rate function on M 9 . More precisely, for a£l, 

• if a < l a ,x(0,0), then ^J a (s) < aj is compact. 

• ifa> Jo,«(?,0), then |j a (s) < a} = M 9 . 

(ii) If l a ,x(0, 0) = do, i/ten J a is a good rate function on M 9 and J a = J*. 
(Hi) If J*(s) < oo, then J a (s) = J„(s). 

(ivj //a < / a , a .(0,0), then {j*(s) < a} = |j a (s) < a}. 
Notice that, like for J and J*, we have 



Ja(s) 



J* a ( S ) if J a *( S ) < DO 

(0,0) if J a *(s) = oo. 



We can now state the LDP for the semi-recursive kernel estimator of the regression. 

Theorem 3 (Point-wise LDP for the semi-recursive estimator of the regression) 

Set (h n ) = (cn~ a ) with c> and < a < l/d, and let (Al), (A2), (A'l) and (C) hold. Then, for 
any open subset U ofM q , 

1 

liminf — —r logP \f n (x) G U] > — inf J a (s), 
rwoo nh% s&U 

and for any closed subset V ofR q , 

limsup —r-r logP \f n (x) G V] < — inf J a (s). 

n ^oo nh% sdV 

The comments made for Theorem Q] are valid for Theorem [31 In particular, we have the following 
corollary. 

Corollary 2 Let the assumptions of Theorem hold. If K is a nonnegative kernel such that 
X ({x G M. d ,K(x) > 0}) = oo, then the sequence (f n ) satisfies a LDP with speed (nh%) and good 
rate function J a . 

Before stating pointwise MDP for the semi-recursive estimator of the regression, let us recall 
that a sequence (u n ) is said to vary regularly with exponent a if there exists a function u which 
varies regularly with exponent a and such that u n = u(n) for all n (see, for example, Feller [9] page 
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275). We will use in the sequel the following property (see Bingham et al. [2 J page 26). If (h n ) 
varies regularly with exponent (—a) and if (3a < 1, then 

1 n 1 

We also consider the following condition. 

sup < do. (16) 

i<n "i 

(For example, this condition holds when h n is nonincreasing). 

Theorem 4 (Pointwise MDP for the semi-recursive kernel estimator of the regression) 

Assume that (h n ) varies regularly with exponent (—a) with a e]0, l/d[, and satisfies (I16p . Let (Al)- 

(A5) hold. Then, the sequence (v n {f n {x) — r{x))) satisfies a LDP with speed ( — ^ ) an d 9°°d rate 



1 n 



function G ax defined in 



3 Proofs 

The proofs of the results for the Nadaraya- Watson kernel estimator are in many cases similar to 
those of the semi-recursive kernel estimator of the regression, so we omit some details of the proofs 
for this last one. 



First, let us state the following propositions which give the properties of the functions $? x , *$> a ,x, 
I x and I a , x - Set 

S+ = (x e R d , K(x) > o} and S- = \x e R d , K(x) < o} . 

Proposition 3 (Properties of ^ x and I x ) 

Let Assumptions (Al) and (A 2) hold. Then, 

i) ^> x is strictly convex, continuously differentiable on R g x R, and I x is a good rate function on 

M? x R. 

o o 

ii) V^f x is an open map and the range of^> x is T>{I X ). L x is strictly convex on T>(I X ) and for any 

t 6 V{I X ) Cl'xR, 

Hi) If X(S-) = 0, then I x (0,0) = g(x)X(S + ), and for any t\ ^ 0, l x (ti,0) = +oo. 

Proposition 4 (Properties of ^f a ,x and I a , x ) 

Let Assumptions (Al) and (A 2) hold. Then, 

i) ^a,x is strictly convex, continuously differentiable on R q x R, and I a<x is a good rate function 
on R q x R. 
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iij V^ ajX is an open map and the range of^ a ^ x is V(I ajX ). I ajX is strictly convex on V(I a ^ x ), and 
for any t £ V(I a)X ) Ci'xl, 

/«,*(<) = ((V*^)" 1 ^).*) " ^a,x ((Vfa,*)" 1 ^)) • (18) 

raj // A(5_) = 0, then l a ,x(0, 0) = g(x)\(S+)/(l — ad), and for any t\ / 0, I a , x (ti, 0) = +oo. 

The two following lemmas are used for the proofs of Theorems Q] and El 
Lemma 1 (Pointwise LDP for the sequence (m n (x) , g n (x)) ) 

Let Assumptions (Al) and (A2) hold. Then, the sequence (m n (x), g n (x)) satisfies a LDP with speed 
(nh^A and rate function I x defined in ([9]). 

Lemma 2 (Pointwise LDP for the sequence (rh n (x), g n (x)) ) 

Set h n = cn~ a with c > and a €]0, l/d[, and let Assumptions (Al), (A2) and (A'l) hold. Then, 
the sequence (rh n (x) , g n (x)) satisfies a LDP with speed [nh~] and rate function I ajX defined in (fT2j) . 

Our proofs are now organized as follows. Lemmas Q] and [2] are proved in Section 3.1, Theorems 
[1] and [3] in Section 3.2, Theorem [2] in Section 3.3, Theorem [5] is proved in Section 3.4. Section 3.5 
is devoted to the proof of Propositions [3] and S] on the rate functions I x and I ajX . Propositions CD 
and [2] are proved in Section 3.6. 



3.1 Proof of Lemmas Q] and [2] 
3.1.1 Proof of Lemma [I] 

For any w = (u, v) & M. q x E, set 

*n(x) 



(m n (x),g n (x)) 



n 



hi 



logE 



exp (nhn{w,i& n (x)) 



Let us at first assume that the following lemma holds. 

Lemma 3 ( Convergence of A n , x ) 

Assume that (Al) and (A 2) hold, then 



lim k n)X (u,v) 



(19) 



where *& x is defined in 



To prove Lemma [IJ we apply Proposition [3l Lemma [3] and the Gartner-Ellis Theorem (see Dembo 
and Zeitouni |6j). Proposition [3] ensures that ^f x is essentially smooth, lower semicontinuous func- 
tion so that Lemma [T] follows from the Gartner-Ellis Theorem. 
Let us now prove Lemma [3l Set 



Zi = [(u,Y t ) + v]K 
For any (u, v) £ M g x R, we have 



x - X,; 



A n Ju,v) 



1 



nh d n 



logE 



cxp 



\i=l 



12 



and, since the random vectors (Xj, Yi), i = 1, . . . , n are independent and identically distributed, we 
get 



A Taylor's expansion implies that there exists c n between 1 and E [e Zn ] such that 
A n,x( u ' v ) = F E [ eZ "- 1 ]-OT( E [ eZn - 1 ]) 2 



^u,y) + v)K{^-) _ 1 



f(s,y)dsdy - R^Uu,', 



* x (u,v)-RgUu,v) + RgUu,v), 



with 



RM(u,v) 
Let us prove that 



Set A > and e > 0; we then have 



e ((u,y)+v)K(z) _ 1 



[f(x - h n z, y) - f(x, y)] dzdy. 



lim RV>(u,v) = 0. 



\z\\<A}xRi 



D ((u,y)+v)K(z) _ 1 



[f(x - h n z, y) - f(x, y)] dzdy 



+ 



f 

J\\\z\\ 



z ((u,y)+v)K(z) _ 1 



\\>A}xRi 

Next, since for any teK, |e* — l| < \t\e^, we have 

,({u,y)+v)K(z) _ x 



z\\>A}xRv 
< 



|z||>A}xR9 



{||z||>A}xK9 



\f(x - h n z,y) - f(x,y)\ dzdy 
(u,y) + v\ \K (z)\ e l<«.i/>+«II^WI |/( x _ hn z,y) - f(x,y)\ dzdy 
(u, y) + v\ \K (z)\ e ^ + ^ K ^f(x - h n z, y)dzdy 



- / \(u,y) + v\\K (z)\e^ +v ^ K ^f(x,y)dzdy 

\\z\\>A}xRi 



< e HIW|oo| 
+e l«|||A-||c 
+e MI|A1|c 
+e l«|||A-||c 

< B 



u\\ I \K{z 
{\\z\\>A} 



V 



\u\ 



i\M>A) 



\\y\\e\\ K \\°°\M\\\y\\f(x-h n z, y )dy 

\K{z)\ I e mMM f(x-h n z,y)dy 

I / \K(z)\dz [ Hylle^ll-NIW/^y)^ 

./{||z||>A} JRi 

f \K{z)\dz [ e mMM f{x,y)dy 

Ju\z\\>A} JRi 



dz 



dz 



{\\*\\>A} 



'{\\z\\>A} 

\K(z)\dz, 



(20) 



[f(x - h n z,y) - f(x,y)]dzdy. (21) 



(22) 
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where B is a constant ; this last inequality follows from ([7]) and from the fact that K is bounded. 
Now, since K is integrable, we can choose A such that 



z|]>A}xI 



,((u,y)+v)K(z) _ 1 



Now, observe that 



{||^||<A}xR9 



D «u,y)+v)K(z) 



\f(x - h n z,y) - f(x,y)\ dzdy < -. 



[fix - h n z, y) - f(x, y)} dzdy 



(23) 



a vK(z) 



dz 



(f(x-h n z,y) - f(x,y))dy 



dz. 



(24) 
(25) 



Assumption (A2) together with ([7]), and the dominated convergence theorem ensure that both 
integrals in ([24"]) and (f25j) converge to 0. We deduce that for n large enough, 



,((u,y)+v)K(z) 



1 



[f{x - h n z, y) - fix, y)} dzdy 



\\z\\<A}xM, 

so that ([H]) follows from (g3D and 
Let us now consider Rn} x ', since c n is between 1 and E [e Zn ] , we get 



< 



(26) 



1 



< max < 1 , 



1 



By Jensen's inequality, we obtain 



Observe that 



|E(Z„ 



< 



E 



({u,Y n )+v)K 



\ u \\\\y\ 



K 



EW 



X - X r . 



X — S 



1 1 

< 



E[Z n 



fis,y)dsdy + \v\ 







f 




/R d xRi 





< h d n (\\u\\ [ \K(z) 



\y\\fi% - Kz,y)dy 



dz + If I / \K(z 



fis,y)dsdy 

fix - h n z,y)dy 



dz 



which goes to in view of © and since lim^^oo h n = 0. We deduce that there exists c G Ml such 
that 



1 



< c. 



Noting that by flTJ), 



E|e* w -l| < h 

< Bh d n , 

where B is a constant. It follows that 



| (u, y) + i>| \Kiz)\e l{u ' y)+vllK( - z)l fix - h n z, y)dydz 



lim R£Uu,v) = 0, 



which proves Lemma El 
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3.1.2 Proof of Lemma [2] 

Similarly as the proof of Lemma [H for any w = (u, v) £ M q x R, set 

§ n (x) = (m n (sc),^ n (a;)), 



1 



■/?. 



logE 



exp [nhn{w,^ n (x)) 



When h n = cn a , c > and < a < 1/d, assume for the moment that 

lim K n>x (u,w) = S& aiX (u,v), 



(27) 



where *$> a ,x is defined in (jlip . The conclusion of Lemma [2] follows from Proposition [4] and again the 
Gartner-Ellis Theorem. 



Let us now prove (|27|) . Set 



M i = [{u,Y i ) + v]K 



then, for (u, ») G f X 



Anx(u,v) 



logE 



x - Xs 



" i=i 



By Taylor expansion, there exists 6j jn between 1 and E 

hi 



logE 



h d 

exp ( 



E 



exp M, 



7^ 



1 



exp ( 

exp (M^ 



E 



26? 



such that 



exp ( 



Noting that h n = cn a with c > and a s]0, l/d[, A nx can be rewritten as 



A n ,x(u,v) 



" 1=1 

1 n 



exp(M^)-l 



exp ( ) - 1 



i=l 



-ad 



R d xRi 



f(x, y)dzdy - R$ x {u, v) + 



with 



1 " 1 / 
2n^ ^ 6? n V 



n 



i=l 



6XP ( Ml f ) " *] 

^«u,»)+«)K'(*) 
e * 



[/(x - /ijz, y) - f(x, y)] dzdy. 



Since bi >n is between 1 and E |exp ( Mi-A 



, we have 



< max < 



E I e h " 



> . 
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By Jensen's inequality, we obtain 



E 



M, 



< 



M, 



Observe that 



h d 

< f d \ | <».//> + r\ 



K 



x — z 



f(z,y)dzdy 



< ht 



\K(z) 



\\y\\f(x - hiz,y)dy 



dz + \v\ I \K(z 



f(x - hiz,y)dy 



dz 



which goes to in view of ([7]) and since lim n ^ 00 h n = 0. We deduce that the sequence ( E 
is bounded, so that there exists c > such that 

1 

77^ < C, 



exp ( M, 



and thus 



8=1 



e * — l 



^3 



Now, in view of ([7]), and since K is bounded integrable, we have 



E 



e * — l 



< E 



hi 



ud 

hi 



M, 



< f d I !(».//} + H 



x — s 



e lv ' 'I V ^ J\f( Sj y)dsdy 



< hi 



< Bhl 



\(u,y)+v\ \K(z)\ e K"*>+ w ll A 'WI/( a ; - hiz,y)dzdy 



where B is a constant. Thus 



and 



cB 2 ld 
< h d 

- 2 n ' 



lim 

n— >oo 



0. 



(2) 

Let us now consider Set ^4 > and e > ; we then have 



— V/i? 

" i=i 



^({«,2/>+t;)X( Z ) 

e » — 1 



1 

n K ~{ J{\\z\\>A}xm 

I + 11. 



e > 



((u,2/>+^)K( 2 ) 



[/(x - /ijz, y) - /(x, y)] dzdy 
1 [f(x-hiz,y)-f(x,y)]dzdy 
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Since |e* — 1| < \t\e^, it follows that 



i=l ■'ill 



||z||> J 4}xIR9 

Using the same argument as in (|22p . it holds that 



|(«, ») + »| |K (z) | e K«.»>+«ll«r(«)l _ , !-2> „) _ „)| ^ 



Now, for I, we write 



nM ^ 



i=l 



^■((«,l/>+«)K(a) 
e h t [f(x - hiZ,y) - f(x,y)]dzdy 



1 n 

n i=l 



[fix - hiZ, y) - f(x, y)\ dzdy. 

On the one hand, Assumption (A2) with u = ensures that 

[f(x-hiz,y)-f(x,y)]dzdy = 0. 

Moreover, since ad < 1, (|15p ensures that 

[f(x-hiz,y)-f(x,y)]dzdy = 0, 



lim 

i— >oo 



lim il> d / 

so that for n large enough, 



z\\<A}xRi 



4 = 1 



{||z||< J 4}xIR'J 



[fix - hiZ, y) - fix, y)} dzdy 



< 



(28) 



hi 



On the other hand, since for i I < n, < < 1, by Assumption (A'l), there exists no £ N such 
that for any i > no, 



^((« )2 />+«)iC(z) 
e h i [f(x-hiZ,y) - f{x,y)]dy 

Noting that by for any a G [0, 1], 

e a ^f(t,y)dy 
Since ad < 1, by ()15p . we get for n sufficiently large 



sup 

t 



< sup 

t 



[ eHIW/(t 5 y)^<oo. 



Vn > i. 



nhi ^ * 



e * 



i=no+l •/{|I*II<A}XR« 

Now, for n large enough, in view of ([7]), 

no „ h 



[/(x - hiZ, y) - fix, y)] dydz 



< 



1 f 



§-««,y>+t;)ijr(2f) 



e i 



z||<A}xR9 



[f(x - hiZ, y) - fix, y)} dydz 



< 



< 



-I no 

™ i=l 
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It follows that for n large enough, 



e » 



*««,»>4«)Jif(z) 



z\\<A}xRi 



f(x - hiz, y) - f(x, y)\ dydz 



< 



(29) 



The combination of ()28p and (|29|) ensures that |/| < — , which ensures that 



lim 

n— >oo 



Hence, (|27p follows from analysis considerations. I 

3.2 Proof of Theorems ffl and [3] 

Let us consider the following functions defined as: 

Hi :R q x R* 

(a, 13) 



and 



Ho 



R 9 
a 

Tr 



(a, (3) 



if p ^0 



a 

P 

otherwise. 



3.2.1 Proof of Theorem Q] 

i) Let U be an open subset of R q , we have 
1 



nhi 



logP[r„(x) G U] = ^logF [(m n (x),g n (x)) G i^ 1 ^)] 



(30) 



Observe that H^OJ) C H^{U) and £Tf 1 (?7) is an open subset on R q x R* which is open, it 
follows that iff 1 (17) is an open subset on R q x R. We deduce from (|30p that 

-LlogP[r„(x) G 17] > 4d lo g P [( m «( x )'5n(x)) Gfff 1 ^)] • 

The application of Lemma [1] ensures that 

liminf _L log P [r n (x) G £7] > lim inf — r log P [(m n (x), g n (x)) G fl'f 1 (C/')] 
.-I — -\ ^ ri '* — v *' " 



n— »oo 77, 



> 



inf I x (h,t 2 ) = - inf J* (a) 
(ti,t a )6flT (^0 seC/ 



and the first part of Theorem [TJ is proved, 
ii) Let V be a closed subset of R q , we have 



1 



logP[r„(x) G V] 



1 



nh d n 



logP[(m n (x), 5n (x)) G H^{V)] 



< 



n 



hi 



logP 



(m n (x),g n {x)) G H 2 1 (V) 
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Now, observe that H^OO = H i l ( V ) u A where icl'x {0} and (0, 0) G A (since for any 
s G M 9 , (0,0) G i?2 _1 ( s ))- The application of Lemma [TJ again ensures that 

limsup j logP [r n (x) G V] < — inf I x (s,t) 

n-^oo nil" (s,t)6i?f 1 (V)UA 

< — inf I x (s,t) 

(M)6ffr»u{(6,0)} 

< - inf IJst,t) 

< - inf I x (s,t) 

sev, teR 

< -mfJ(s), 

where the second inequality comes from Condition (C); this concludes the proof of Theorem 

m ■ 



3.2.2 Proof of Theorem M 

Applying Lemma [21 Theorem [3] is proved by following the same approach as for the proof of 
Theorem Q] with replacing m n , g n , J* and J by m n , g ni J* and J a respectively. ■ 

3.3 Proof of Theorem [2] 

Set 

B n(x) = —— {m n (x) - m(x)) — (g n (x) - g{x)) . 

g(x) g{x) 

Let us at first state the two following lemmas. 

Lemma 4 Under the assumptions of Theorem^ the sequence (v n {B n {x) — E(B n (x)))) satisfies 
a LDP with speed {^-jr-^j and good rate function G x . 

Lemma 5 Under the assumptions of Theorem^ 

lim v n E(B n (x)) = 0. (31) 

n—*oo 

We first show that how Theorem [2] can be deduced from the application of Lemmas H] and 
and then prove Lemmas d] and [5] successively. 

3.3.1 Proof of Theorem [2] 

( nh d \ 

Lemmas H] and [5] imply that the sequence (v n B n (x)) satisfies a LDP with speed I — Tp- and good 

W / 

rate function G x . To prove Theorem [21 we show that {v n {r n — r)) and (v n B n ) are exponentially 
contiguous. 

Let us first note that, for x such that g n ( x ) 7^ 0, we have: 

m n (x) m(x) 

r n (x) — r{x) - 



g n {x) g{x) 
(m n (x) - m(x)) g(x) + (g(x) - g n {x)) m(x) 



B n (x) 



g n (x)g(x) 

g(x) 
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It follows that, for any 5 > 0, we have 



Vnll ( r n(x) - r{x)) - B n (x)\\ > 6 

g(x) 



< 



v n \\B n (x) 



1)\\>5 and g n (x) + + P [g n (x) = 0] 



< F[y/v^\\B n (x)\\ >5}+F[^\g(x)-g n (x)\ >5\g n (x)\]+F 



\g{x) - 9n(x)\ > 



< F[^\\B n (x)\\> 5}+F 



v n \g(x) - g n (x)\ > 5 \g n {x)\ and i^l > ]- 

g(x) 2 



+P 



g n {x) < l 

g(x) ~ 2 



+ 



\g n (x) - g(x)\ > 



g(x) 



< F[^\\B n {x)\\ >5]+F 

g(x 



v n \g{x) - g n (x)\ > 5 



g(x) 



+ p 



g(x) - g n {x) > 



g(x) 



+p 



\gn(x) - g(x)\ > 



Since linin^oo v n = oo, it follows that, for n large enough, 
F\v n \\(r n (x)-r(x))-B n (x)\\ >8 



v n \\B n (x)\\ >S] ; P 



< 4 max 



and thus 

logPkll (r n (x) - r{x)) - B n {x)\\ > 5 
nrvt L 



v n \g{x) - g n (x)\ > 5 



g(x) 



n 



< -^l og 4 + max<|-^logP[V^||i?n(x)|| > 5} ; log 



n 



hi 



v n \g[x) - g n (x)\ > 5 



g{x) 



ntit 



Now, since the sequence (v n B n (x)) satisfies a LDP with speed ( — ) and good rate function G x , 
there exists c\ > such that 

Iimsup-^logP[V^||5 ft (aj)|| > 6] < -c x . 



Moreover, the application of Theorem 1 in Mokkadem et al. [M] guarantees the existence of C2 > 
such that 



lim sup — log 1 

7 

We thus deduce that 



n^oo 



Vn \g(x) ~ 9n{x)\ > 5 



g{x) 



< -c 2 . 



lim ^logF\v n \\(r n (x) - r(x)) - B n (x)\\ >5 

n^oo nil® I 



-oo, 



which means that the sequences (v n (r n (x) — r(x))) and (v n B n (x)) are exponentially contiguous. 
Theorem [2] thus follows. ■ 
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3.3.2 Proof of Lemma H 

For any u G M 9 , set 

r n>x («) = 
M^) = 



1 



exp 



nh d 

-^(u,B n (x)-E(B n (x))) 



(u, y - r(x)) 2 K 2 (z)f(x, y)dzdy 



K 2 {z)dz. 



To prove Lemma HI it suffices to show that, for all m£K', 

Urn T nx (u) = $ x (u). 

n— »oo 

As a matter of fact, since & x is a quadratic function, Lemma U] then follows from the application 
of the Gartner-Ellis Theorem. For u 6 M 9 , set 



(u,Yi-r(x))if 



x - X 



and note that 



r„, x (V) 



hi 



logE 



(1 n 



Since (Aj,Y^), i = 1, . . . , n are independent and identically distributed, it holds that 



g v n g(x) 



h d n g(x 



-E(Z n ). 



Now, we follow the same lines as in the proof of Lemma [3l A Taylor's expansion ensures that there 

such that 



exists c n between 1 and E 

,2 



g ■"n.g(x) 



K 

"n 
.,.2 



■E 



2»j 



g v n g(x) 



u 



v n g{x. 



■{u,y- r(x))K(z) 



f(x,y)dzdy 



with 







^E 





and 



— k-^(u,y-r(x))K(z) -. 

g vng(x) N ' a v " w — ]_ 



(u,y - r(x))K (z) 



f(x - h n z,y) - f(x,y) 



— < max < 
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Noting that 



E 



v n g{x) 



< 



KM 
v n g{x. 

^nlMI \\ r ( x 

v n g{x) 



\K{z) 



It follows from ([7|) that, 



E 



v n g(x) 



\K(z) 



0. 



x — h n z, y)dy dz 
f(x - h n z,y)dy 



dz. 



(32) 



We deduce that there exists d G Ml such that 



4 <c, 



and thus, in view of ([7]). 



f(s,y)dsdy 



< -^—h d 



< 



2g 2 (x) n \Jm. d xRi 
2\\K\\°o liuliiir^H 

c'e 5P5 " tt "iin*;ii , 



/(x - h n z,y)dzdy 



2g 2 {x) 



(u,y-r(x)}K(z)\e\^ {u > y - r{x))K{z) \ 



\(u, y - r(x))K(z)\ e ^ VH f(x - h n z,y)dzdy 



< Bhl 



where 1? is a constant, so that 



lim 

n— >oo 



0. 



2 3 
X X 



On the other hand, since Vx G K, e 1 - 1 - x = 1 d(x), with < e' x ' , we get 

2 6 



2$ ( x ) Jr^xR? 



with 

|^n,*(«)| < 



(u, y - r(x)) K (z) [f(x - h n z, y) - f(x, y)\ dzdy + K n , x (u), (33) 



\(u,y- r(x)) 3 K 3 (z)\ e W)^ y - r{x))K ^ ^ _ ^ ^ _ ^ ^ ^ 



6v n g 3 (x) J R dxRi 

It follows from flTJ) that Tl n ^ x converges to 0. Applying then (A2) and (A3), we find 



lim 

n— »oo 



R n,w( u ) 



0. 



Finally, we have 

r n ,a,(u) 

„.2 



v n g(x 



■(u,y- r(x))K(z) 



f(x,y)dzdy - R^Uu) 
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with 



-±^{u, y -r{x))K(z) _ 1 _ (u,y -r(x))K (z) _ {u,y -r{x)) 2 K 2 (z) 



By the maj oration 



< 



e x — 1 — x 



< 



-d(x) 



v n g{x) 



, we get 



2vlg 2 {x) 



f(x,y)dzdy. 



6v n g 3 (x) J R d xRq 
and d?]) ensures that 



\(u,y- r(x)) 3 K 3 (z)\ e ^ l{u ' y ~ r{x))K{z)l f(x, y)dzdy, 



lim 

n— >oo 



0. 



which concludes the proof of Lemma UJ 

3.3.3 Proof of Lemma [5] 

Observe that 



E(B n (x)) 



g(x 



' TE (m n (x)) - m{x)} - 44 [ E (0*0*0) " ■ 



Since 



E (m n (x)) - m{x) = -^E ( ) ) - '»(/> 



n 

X — Z 



fin ./HdvW9 \ fir 



f(z,y)dzdy - m(x) 

JM. d xRi \ ">n / 
—7 / m(z)K ( — ) dz — mix) 

K{y) [mix - h n y) - m{x)\ dy, 

Assumptions (A5)i), (A5)iii) and a Taylor's expansion of m of order p ensure that 

E(m n (x))-m(x) = 0(h p n ). 

Similarly, we have 

E(g n (x))-g(x) = O (h p n ) . 
We deduce from flM}, ([35]), and ([36D that 

E(B n (x)) = O(hP), 
and thus Lemma [5] follows from Assumption (A5)ii). ■ 



(34) 



(35) 



(36) 
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3.4 Proof of Theorem [4] 

Set 



BJx) 



(rh n (x) - m(x)) - ^-r (9n(x) - g(x)) , 



g{x) 



and, for any u G M 9 , 

(it) 



logE 



1 



nk 



exp — - (it, B n (x) — E ( -B n (x 



2(1 + ad)g 2 (x] 
1 u T T, r u 



(u,y - r(x)) 2 K 2 (z)f(x,y)dzdy 



K 2 (z)dz. 



1 + ad 2g(x) 

By following the steps of the proof of Lemma 2] and by using the property (|15p , we prove that 

lim t n , x (u) = & a ,x(u). (37) 

n— >oo 

We first show how (|37p implies Theorem HJ The function <& a ,x being quadratic, the application of 
the Gartner-Ellis Theorem then ensures that 

the sequence (^v n (jB n (x) — E ^I? n (x)^^ satisfies a LDP 
(nh d \ 

with speed — ^ and good rate function G ax . (38) 
V v£ J 



Now, following the proof of Lemma [SJ we have 
E (m n (x)) — m(x) = - ^ 



x — z 

yK [ ) f(z, y)dzdy - m(x) 



I f 

= -/^ K(y) [m(x - hiy) - m(x)} dy. 
Here again, Assumptions (A5)i), (A5)iii) and a Taylor's expansion of m of order p ensure that 

E (fh n (x)) — m(x) 



and similarly, 



E(g n (x))-g(x) 



thus 



v n E[B n (x) 



i=i 
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If ap < 1, since (h n ) varies regularly with exponent (—a), we have, in view of (|15p and 
Assumption (A5)ii), 



i=i 

If ap > 1, we have Y^i h\ < oo and thus, since v n = o(n/i^), we get 

n 



n 



In the case ap = 1, let £ be the slowly varying function such that h n = n a C(n), and set 
e > small enough. Since a(p — e) < 1, we have hn = o(hn~ e ), and in view of (fT5j) and (A4), 



i=l 



o ra 



o n 



oil). 



We thus deduce that 



lim v n K(B n (x)) = 0. 



(39) 



To conclude the proof of Theorem U we follow the same lines as for the proof of Theorem [2] 
(see Section 3.3), except that we apply (f38l) instead of Lemma HI (j39|) instead of Lemma El and 
Theorem 1 in Mokkadem et al. [13] instead of Theorem 1 in Mokkadem et al. [II J . ■ 
Let us now prove ((371) . For u £ W, set 



{u,Yi-r(x))K 



x - Xi 



and note that 



r n , x («) 



n 



hi 



logE 



hi 



exp 



■ J n9(x) ^ hf 



Since (Xj, Yi), i = 1, . . . ,n are independent and identically distributed, it holds that 



,v n g(x)hf 



ng{x) ^ /if 



- 1 



By Taylor expansion, there exists Q jn between 1 and E 

L CL rr-i j d rr\ 

logE e^pcao * = E e u «^0) 1 — 1 



1 



such that 



E 



and r„ T can be rewritten as 
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nh d 



E E 



i=i 



, v n g{.x)h^ 



E 



2nK — c ln 



E 



, v n g(x)hf 



n 1 

ng{x) f^hf K %) 



A Taylor expansion implies again that there exists c i n between and - — " d such that 



E 



, v„g(x)h d 



h d 1 
^—rEiTi) + - 



■j n g(x)hf 2 \v n g(x)hf 



hi 



E(Tf) + - 



hi 



6 \v n g(x)hf 



E(e<"7f) 



Therefore, 

T n Ju) 



1 1 



Eld / («,y-r(x)) 2 K 2 (z)/(x,2/)^ ( iy + i?g)( U )+ J Rg^ ? x), (40) 



2g 2 (x) nh n d hf jRd xRq 



with 



m 



u 



- \ E(e »>™T- 3 

6 v n g 3 (x) n r-^ hf d 



,2 n 



h d 1^1 



2# 2 (x) n ^ /if 7iRd x]R9 



2nhi £j c- n 



(w, y - r{x)) 2 K 2 (z) [f(x - hiZ, y) - f(x, y)] dzdy. 



E 



ig(x)hf _ I 



In view of (|15p . the first term in the right-hand-side of (|40p converges to $ 0): 
It remains to prove that Rn}x and Rn)c converge to 0. We have 



E 



h d T- 



< 



id 



v n g(x)hf jRd xRq 



(u, y — r(x))K 



x — s 



f(s,y)dsdy 



^ ""n 



In view of ([7]), the integral is bounded, thus 



| {u, y - r(x))K (z)\ f(x - h^z, y)dzdy. 



lim supE 

n ^°° i<n 



h d T- 



so that, there exists c > such that 



v n g(x)h1 



< c. 



Now, on the one hand, since \e l — 1| < |t|e' 4 ', and in view of (|T|) and (|16p . we have 

h d 



E 



,v n g(x)hf _ 2 



< 



v n g(x) 



\(u,y-r(x))K(z)\e c \^ y - r{x))K{z) \ 



f(x - hiZ,y)dzdy 



< B 



h" 



X v n g{xY 



26 



where B\ and c are constants. We deduce that 



2 n i / 



e v nS (x)hf _ J 



On the other hand, 



E 



< E 
< 

< B 2 ht 

where B2 is a constant. Thus, 

hl d 



\(u,y- r(x)}K(z)\ 3 e^ l{u ' y - r{x))K(z)l f(x - h { z, y)dzdy 



6nv n g 3 (x) ^ tif d 



1 



< < Af, 



Since lim 



n— >oo 



0, (fT5l) ensures that 



/i M 1 
lim " — / — : 

n-s-oo 6v n g d (x) n hf 



n 



0, 



which proves that 



lim 

n— >oo 



0. 



Finally, using ([T5jh (A2) and (A3), we have 
lim m(u) 



lim 



1 EILA 



1 n r 

lT-T- d E V / ^ V ~ r(x)) 2 K\z) [f(x - hiz, y) - f(x, y)] dzdy 



which proves ()37|) . ■ 

3.5 Proof of Propositions [3] and [4] 
3.5.1 Proof of Proposition [3] 

• The strict convexity of ^f x follows from its definition, since for any 7 e]0, 1[, and (u,v) 7^ 

*x (7 («,«) + (1-7) «0) = ^ a; ((7^ + (l-7)'" / ,7« + (l-7)^)) 

J( 7 «+(i-7K,y)+7»+(i-7K]^(^ _ A f( Xi y)dzdy 

{e ({u,y)+v)K(z) _ A f( Xj y) dzdy 



< 7 

+(1-7) 



Uu',y)+v')K(z) 



l) f(x,y)dzdy, 
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where the last inequality follows from the fact that x i— > e x is strictly convex. 
Since \e l — 1| < |i|e'* W € M and -fT is bounded and integrable, (J7J) imply that 



X(u,y)+v)K(z) 



l)f(x,y) 



dzdy 



< 


1 1 




JR d xRi 


< 


e MII*ll» 




+e M\\K\ 



V 



which ensures the existence of & x . 
Next, set 



|((u, y) + v) K{z)\ e l««if>+^WI/( x , y)dzdy 

K(z)\dz [ \\y\\e^M^°°f(x,y)dy 
K ( :)| r/ : / e 11 " 11 ^ 1111 ^ 11 -/^,^)^ < oo, 



f{x,y). 



h x (u,v,y,z) ■ 
Since h x is differentiable with respect to (u, v ) and 

ye^ u ' y ^ K ^K(z)f(x,y) 



Vh x (u,v,y,z) 



e ((«,v)+v)K(*)K(z)f(x,y) 



using Assumption (Al) and ([7D, it can be seen that ^f x is differentiable on M q x M. Since ^> x is 
a smooth convex on M q x R, it follows that *$> x is essentially smooth so that I x is a good rate 
function on I' x I (see Dembo and Zeitouni [6j), which proves the first part of Proposition 

El 

o 

Now, observe that T>(^ x ) = R' x R, and since $? x is strictly convex, it holds that the pair 
T>{^ x ) : ^ x I is a convex function of Legendre type. It follows that I T>(I X ),I X I is a convex 



function of Legendre type (See Rockafellar [IT]). Thus, Part 2 of Proposition [3] follows from 
Theorem 26.5 of Rockafellar |17j . 

Let us now assume that A(5"_) = 0. Thus 



$? x (u,v) 



For each u £ M g , the function v {^ uT v K { z ) e vK i z ) _ 1^ A s+ (z)f(x, y) is increasing in v and 

goes to —f(x,y) when v — > — oo. Thus lim^-oo *& x (u, v) = —g(x)X(S + ) and I X (Q, 0) = 
g(x)\(S+). Now, when t\ ^ 0, let us show that 

4(ti,0) = +oo. 

Let M > 0, e > and set u = (M + e)ti/\\ti || 2 . Let u G E such that 

f -^ x (u,v) > g(x)\(S + ) - e if A(5+) < oo 
\ -V x (u,v)>M if A(S + )=oo. 

Then, on the one hand, when \(S+) < oo, we have 

u T h -^ x (u,v) > M + e + g(x)X(S+) — e > M. 

On the other hand, when A(5+) = oo, we get 

u T ii - V x (u, v)> M + e + M > M. 

It follows that sup u „ [u T t\ — ^ x (u,v)) = +oo. ■ 
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3.5.2 Proof of Proposition [4] 

Following the same lines of the proof of Proposition [31 we prove Proposition 2J When A(5_) = 0, 
for each u G R 9 and s G]0,1], the map v ^ s~ ad ^ ad ^ T yK(z) e vK{z) _ A lg+ ( z )/( x , y) is in- 
creasing in u and goes to —s~ ad f(x,y) when t> — > — oo. We deduce that lim„_ > _ tX) ^^(it, i>) = 
- 5 (x)A(5+) Jo s- ad = - 5 (s)A(S + )/(l - ad) and 4(0, 0) = g(x)\(S+)/(l - ad). ■ 

3.6 Proof of Propositions CD and [2] 
3.6.1 Proof of Proposition Q] 

(i) Let us prove the first part of Proposition (TJ 

• If a < 4(0,0), set 

G={(o,i>)eK'x R, 4(0,6) < a} and G = {(s,()el ? xM, /,.(«,*)< a}. 
We first show that G is a compact subset of R 9 x R. 

First, observe that since 4 is a good rate function, G is a compact subset of R 9 x R. 
Let us define the following function 

F : R 9 x R -> K'xl 
(s,t) 1— > (st,t). 

Observe that F is continuous and G = F^ 1 (G). We deduce that G is a closed subset of 
R 9 x R. 

Now, let (s n , t n ) be a sequence of real numbers of G, there exists (x n ,y n ) G G such that 

The compactness of G on R 9 x R ensures that there exists a sequence of real numbers 
(x nk ,y nk ) G G such that (x nk ,y nk ) -> (x ,yo) as A; -> oo, where (x ,yo) G G. Therefore, 
(sn fc 4 fe ,4 fc ) (^o,yo) as A; ->• oo. 

Noting that Condition (C) ensures that Vs G R 9 , 4(s,0) > 4(0,0) > a so that (s,0) ^ 
G. 

It follows that yo 7^ 0, and thus t nk — > y and s nfe — > so as — > oo, where so = xo/yo- We 
deduce that (s nk ,t nk ) — > (so, 2/o) as /c — > oo, so that (so,2/o) £ G*. Thus G is a compact 
set. Now we claim that the set A = {s, J(s) < a} is the image of G by the continuous 
map 7r : (s, t) i— > s, and thus it is a compact. 

Indeed, clearly n(G) C A For the opposite inclusion, consider a < a' < 4 (o, 0^ ; 
the set G' = ^I x (s,t) < a'j is compact. Let so G A, since J (so) < a, we have J(so) = 
inf / o t ) g Q/ 4(so, t)\ by compacity, there exists to such that J(sq) = I x (so,to); (so, to) G G 
and ir(so,to) = so, thus A C vr(G). 

• If a > 4(0, 0), let s G R 9 , we have 

J(s) < I x (st,t) Vi 

< 4(0,0) 

< a. 

We deduce that R 9 C { J(s) < a} and the second part of Proposition [TJ (i) follows. 

(ii) It is an obvious consequence of (i) and the definitions of J and J*. 
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(iii) Assume that J*(s) < oo. 

• If 4(0,0) > ml t I x (st,t), then 

inf I x (st, t) = inf^o Ix(st, t), 

so that J(s) = J*(s). 

• If 4(0,0) = inf t I x (st, t), since J*(s) < oo, there exists to ^ such that 4(sio>^o) < °o. 
By the convexity of I x , we have for any v £]0, 1], I x {stQV,tov) < oo and 

I x (st v,t v) < ul x (st ,t ) + (1 - f)4(0, 0). 

We deduce that 

< I x (st u,t u) - 4(0,0) < (4(st , to) -4(0,0)) , 

and if we take v — > 0, the third part of Proposition [T] follows. 

(iv) Let us suppose that a < 4(0, 0) and let s £ {J* (s) < a} , then we have J*(s) < oo. We deduce 
from (iii) that J(s) = J*(s). It follows that J(s) < a, which ensures that s £ {J(s) < a}. 
Conversely, if s £ {J(s) < a}, then 

4(0,0) > inf4(sM), 

so that 

inf4(st,i) = inf I x (st,t). 

That is J(s) = J*(s). Therefore, J*(s) < a, which ensures that s £ {J*(s) < a}, and thus 
Proposition Q] is proved. ■ 

3.6.2 Proof of Proposition [2] 

Proposition [2] is proved by following the same approach as for the proof of Proposition Q] with 
replacing I x , J and J* by I a>x , J a and J* respectively. ■ 
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